
Europaisches 
Patentamt 



European 
Patent Office 



Bescheinlgung Certificate 



Attestation 



Die angehefteten Unterla- 
gen stimmen mit der 
ursprQnglich eingereichten 
Fassung der auf dem nach- 
sten Blatt bezeichneten 
europSischen Patentanmel- 
dung Qbereln. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les docunnents fixte d 
cette attestation sont 
conformes d la version 
Initialement d6poste de 
la demande de brevet 
europ^en sp6cifiee a la 
page suivante. 



Patentanmeldung Nr. Patent application No. Demande de brevet n- 

02079154.7 



o 
o 




CO 



'priority document 

iSUBMITTHD OR TRANSMITTED IN 

CXJMPLIANCEWITH 
1 RULE 17.1(a) OR (b) 



Der Prflsldent des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Ije Pr6sldent de I'Office europeen des brevets 
P.O. 



R C van Dijk 





Europaisches 
Patentamt 



Euroffl 

Patenf 




ice 



Office europ^en 
des brevets 



Anmeldung Nr: 

Application no.: 02079154.7 



Demande no: 



Anmeldetag: 

Date of filing: 03.10.02 
Date de d^pdt: 



Anmel der/Appl 1cant( s)/Demandeur( s) : 

Koninklijke Philips Electronics N.V- 
Groenewoudseweg 1 
5621 BA Eindhoven 
PAYS-BAS 



Bezelchnung der Erf Indung/TI tie of the 1 nventi on/Tl tre de T Invention: 
(Falls die Bezelchnung der Erflndung nicht angegeben 1st, slehe Beschrelbung. 
If no title Is shown please refer to the description. 
SI aucun titre n'est 1nd1qu4 se referer a la description.) 

Method for reversible embedding 

In Anspruch genomroene PrlGrlat(en) / PrIorltyCles) claimed /Pr1or1t6(s) 
revend1qu6e(s) 

Staat/Tag/Aktenzelchen/State/Date/Flle no./Pays/0ate/Num6ro de dSpdt: 



Internationale Patentklassi f Ikatlon/Internatlonal Patent Classification/ 
Classification Internationale des brevets: 

G06F1/00 

Am Anmeldetag benannte Vertragstaa ten/Contracting states designated at date of 
fUlng/Etats contractants d^slgn^es lors du d6p6t: 



AT BE EG CH CY CZ DE DK EE ES FI FR 6B GR IE IT LI LU MG NL PT SE SK TR 



02079154.7 

EPA/EPn/nFR Fnrm 1014.2 ^ 01 . 2nnn 7001014 



2 



^v.'-s^,^,™^ ^OO'' 03.10.2002 16:30 

PHNLD21017EHP - 



1 03.10*2002 

Method for reversible embedding 



PIEIX) OF THE INVEJOTI^ 

This invention disclosure addresses the problem of embedding in&imation &r 
high qiiaUty restoration in a lower quality signal, ^vvtiere the signal is typically an audio*visual 
signal. 

S 

BACKCmOXJND OF THE INVEOT 

One of Ote proposed mei&ods £br Digital Rights Man^^ement: (pRM) of 
quality audio content invohres makiag only low qualitir versions avaikible to unlicensed 
usets. lioGEDsed users however are provided with some additional information* typically a 
1 0 cryptogr^bic Icsy^ that allows ihem access to an additional quality lay er, so as to obtain the 
original bigh quality content Typically ibe additional quality layer is provided as a separate 
and enczyptedbifefreasDo, i.e. separate &om the low quality bit streanx An exanqile of such a 
dual layer quality approach can be fbund in the DRM methods bdng proposed fin: DVD- 
Audio. 

IS The presence of two separate bit streams poses a security risk because the 

encryptsd high quality layer is easily traceable, and 'Qierdbre accessible for cryptograpbic 
attacks. For example, by playing out the high quality layer of DVD-Audio, an attacker can try 
to exploit the observed relation between the encrypted and decrypted bit streams for 
retrieving cryptographic keys. 

20 

OBJECT AND SUMMARY OF THE INVENTION 

To overcome the sketched problem we propose to multiplex ttue low quality 
and higli quality layer iixto a single bitetream This is done in such a way that th© multiplexed 
bit$tream has only minimal distortion with respect to the low quality layer. The high quality 
25 layer is embedded in this minimal distortion of the low quality layer and can be made 

available by providing a proper decoder. The theoretical bounds that can be achieved with 
respect to distortion and rates are provided in appendix 1. 
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2 03ao;2002 
An (admittedly) toy exan^le of how this can be achieved mvolves a eimple 
scalar quantiser Qi and a more sophisticated vector quantizer Q2 that have flie aame rate. 
fbis B&tap a sonice X can be quantized with the high quality quantizer Qi. Ihat means that 
every coding vector x in X is ^roximated by a vector qzQO^ &r acme index k. As Qi and Qz 
5 have tiiie same number of coding vectors, it is possible to find a leoxdexing r((c) such that 
qi(rCk)) is also an approximation to x, although in general of l^s qualify. An unlicensed user 
will then be given a set of indices with respect to the scalar quantizer Qi and he will be able 
to reconstruct a low quality approximation to X. A Hcensed user will have access to the code 
vectors in Q2 ^ ^ inverse of tbe reordering map r(k) and will therefore be able to 
10 reconstruct a better approximation to X. An exan^le of sudh an double quantizer construct is 
provided in appendix 2» 



DESCRIPTION OF EISdBODIMBNTS 
15 These and other aspects of the invention are apparent from and will be 

elucidated^ by way of a non-lhnitadve example^ with referaice to the embodiment(s) 
described in the appendices 



Throughout tiie figures, same reference numerals indicate similar or 
20 corresponding features. Some of &e features indicated in the drawings are typically 

implemented in software, and as such represent software entities, such as software modules 
or objects. 



Although the invention has been described with reference to particular 
25 illustrative embodiments^ variants and modifications are possible within the scope of Ibe 
inventive concept Thus» for example. 

The use of the verb 'to comprise' and its conjugations does not exclude the 
presence of elraients or steps other than those defined in a claim. la the claims, any reference 
signs placed between parentheses shall not be construed as limiting the claim. The invention 
30 can be implemented by means of baidware compn^ng several distinct elements, and by 
means of a suitably programmed computer. In the device claim enumerating several means, 
several of these meam can be embodied by one and the same item of hardware. 
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A 'computer program* is to be uxiderstood to xneeiti any software product 
stored on a conipiiter-readable medium^ such as a floppy-disk, dowiUoadable via a network^ 
such ai3 the latemet, otinarkstable in 



ocnbodiments, it will be md^stood that tncdiHcations thereof wiftun the principles outlined 
above will be evident to those skilled in the arf^ and thus the invention is not Umited to flie 
preferred eixibodJmente but is intended to encon^ass sudx modifications. The invention 
re^es in and every novel characteristic feature and each and every conibinaition o f 

1 0 chatBCtedstic fbatures. Reference numerals in the claims do not limit thdr protective scope. 
Use of the vearb comprise" and its conjugadon^ does not exclude the presmce of elements 
other than Hiose stated in the claims. Use of the article ^'af or ' W preceding an element does 
noteKcludelbepresenceof aplmalityofsuchelements. *M€»x^' ^aswillbeai^arenttoa 
person skilled in the arl^ are meant to include any hard-ware (sxich as separate or integrated 

IS circuits or electronic eLemuaits) or sofi^ware (such as programs or parts of programs) which 
perfiontm in operation or are designed to perform a specified fimctionft be it solely or in 
conjunction with o(h« functions, be it in isolation or m co-opaation with other elements. 
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While the invention has been described in connection with preferred 
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Reversible Embedding Methods 

Frans Willems and Ton Kalker 

PbiHpa Research LaboialoriBS and Eindlioven Universityy J^dhoven 



Abstract 

We comider emboddlng of msssages (data-hiding) into iJ.d* source (hjost) sequences. 
As in [7] and [8] wo fbcus cm fhe case Ttrhero zeconsfntctioA of fhe sotitee seqiienoe ia 
desired. Instead of complete reconstructkm however we investigate tho case where there is 
only partial reconstruction (restoration) needed. Embedding has an on the rate of the 
composite sequence. This effect is i^ken into account in Ottr ixwestigatiooSt The optimal 
trade>:off between ranbeddiiig rate^ composite rate, distortion betvireen source seqjienoe and. 
composite seqjofiiice, and diatottion between source sequence and lestoiation seqoence is 
given by tbe adniissQ^ld region. Ihis admissible tegiosx is detemiined here. 

1 Introduction 

A side effect of many watermarking and data-hiding methods i? that the source (host) signal 
into which messages are embedded is distorted. Finding the optimal trade-oif between the 
amount of information embedded and the induced distortion is therefore an active field of 
research. In reoent yeais^ with the rediscovery (see e.g. [10] and [3]) of Co&ta^a &emhial 
paper "Writing on Dirty Paper*' [5], there has been considerable progress in understanding the 
fbndamental lijptkit$ of the edacity versus distortion of watemarldng and dalaphiding schemes. 
Fof some appHoaticms no distortion resulting fi:om embedding messages is allowed. In these 
cases the use of reversible data-hiding methods provide a way out A reversible data-hidimg 
method is defined as a scheme that allowa blind recov^ of the original host data. A reversible 
scheme was proposed by Fridrich et al. [7]. Receootly theoretical progress has been made in 
understanding the limits of reversible watennaridivg in tenns of fate' versus distortion [8]. It 
is Ihe purpose of the present p^er to investigate embedding in the case where only partial 
leconstrucfiGn is required. 



2 System description 

Consider a source that pioduoes a sequetice ^ (p^u^2,'" ^ ^isr) of if independent and 
identioally distributed (iJ.d.) srymbols, i.e. fbr some distribution {^(x), x ^X] 

Pr{JSrf « x\!) = n«oi.Af PriJr„ « Xn) = nn^xM^n). _ (I) 

for all e wh^ X is tbe (finite) source alphabet. The positive integer N is called the 
Uool&-l&ngth. Into the source sequence a message index w is embedded, This message 



I source * 









encoder 
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decoder 



w 



judex as8umo$ values in {1,2» 
imifcxnnly distxttnited, hence 



Kgure 1: A geneial embedding system. 

, M} wd is independfflt of the souzoe sequence and 



Pr{jr = to}=^l/M,fiM:aUuj e{l,2.-- ,Jl/). 



(2) 



The encode (embedder) znaps each soujrce sequence together with the message index w 
to a seq]gi^e s (yi, j^, * • ' , yAr)i refexred to as a composite sequence. This composite 
seqt;^iice consists ofN components Sam the finite composite alphabet y. We.write 

y^ a eOc^, w) = (eiC^i^, tu), <3a(^f , w), - ej^rCxf , w)) . (3) 

where ^(-t *) is the encoder mapping and •) fern := 1, A'axeitsptojections* 

Observing the composite sequence y^^ the decoder detennines a rBstoration sequence ^ 
(zu • • • » ^n) of symbols from the finite alphabet thus 

f(y?) = C/i(yi^). /zCy^"), • • • . /j^Cyf')) . (4) 

where fO} is the decoder mapping and where for n = hN, fnO) is fbQ coixespondix^ 
projection. 

Moreover the decode produces m esttmete i& of the message index that waa einbedde4 
thus 

iD-^O^f), (5) 

This estimate assumes values in {1, 2^ « - > « M}^ 

The e3^ected distortion between the composite sequence y^ and the source sequence xf^ 
isdefinedas 

for some matrix jD;FyO, and where generally is expected to be sma&» We ^sume that 
Che matrix: I>xy(.'* 0 cont^$ non-negative finite enides only. 

The composite seqiiBnce y^ is compressed on the basis of its first order ^tropy This 
leads to two possible definitions for a composite rate, where Rc === H^Y) is an obvious choice. 
Another option, m particular in applications where yf is obtained from a scalar quantiser, is 
to use symbol-by^^ymbol coding, using the same binary prefix code for all 17 symbols. If the 
codeword lengdis hi binary symbols are (2(y), y € y]^ Aen he corresponding composite rate 
jRfl is then defined as 



(7) 
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definitioij; however all results presented will still hold true wifli replaced by H(7) 

in case of 2ionr^ymhol-*by-synibol encoding. In gcnmlly the rate JRe should be as small as 
possible. 

Also e^cpected distortion betv^e^ source seqiience and lestGocatlon sequence has 
to be small, and is defined as 

for some matrix jDx^Cs -) that contams non-negatiYC finite entries only. 

Of course, the number of allowed messages ejcpressed by the embedding rate Rc 

Hc^^lQBi^^ (9) 

should be as large as possible. 

Finally the average ezror probability P^, defined as 

P^^ Pr{X^^x?}Vr{W^wh (10) 

xr=^(«c<,w)) . 

should be as smaU as possible. 

3 MaiB result i 

Now that we have descxibed a general ^bedding system we can proceed to ^ mainresult of 
this paper, the admissible region for general embedding. First we have to define admissibility. 
Following standard practice, we define a quadruple (p^, p^, A^y, Axs) to be admissible if fbr 
all^ > Ol3iereisanumberiSr« such that for aUiV* > iV^ there exist encoders and decoders such 
that 

Jie > Pe^ ^» 
^ Pa + «» 
Ay S ^xy + fff 

- P« -< . (11) 

In the following sections we will prove the following result: 

Theorem 1 AsetH ^ {(p«, p6f A^^, A^s) of quadruples is admissable if and only if there 
esdj^ a JointprobabiHfy distribution P(pc, y^z) ^ QOc)P(yt z\x) suck that 

Pc > W), 

0<Pa<OT)-/(Jf;7.Z). 

where H(X) is tke binary entropy of the mar^nal distribution P(y) and wh^re E[-] is the 
e^ectation opetaton 

The following two sections will proof this result. The easy part, i.e. the converse, is done first 
in Section 4« The moxe involved part, ie. achievability, is done in Section 5. 
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GivenangeneialsiiibeddmgsyetemasiiiFigarelwefiistdefinethejoint^^ 7, Z), 

To Ois Ofid, consider the tandom vaiiable / assomuig values &om {1,2,"-,N} with proba- 
biHty 1/J</, indepeaodefidy. Next defioe &e <»nditi<mJ sb^ 

(X,Y,Z\I=^n)^iXn,rn,Z„). (12) 
Ifote that ntmaepdoobabm^distribidon for (X, y,Z)^ giveaby. 

Er{(;!r. r, Z) « (x. 7, «)} 2 ^^CCATa. Tb. Z«) = («. J*. a)K (13) 

forx e Ar,y ey.and^ e ^. Note llwtfiwtbis joint probability PC»,y,») w oaiivni^ 
i'Cx.^'.z) = Q(x)PCy,z\xyi. 

The proof now proceeds in. a ompber of e/te^is. Wc start by by using Fano'fi inequality to get 
a lower bound m the rata Ra in terms of the ooodidonal piobabilily H(.W\7{^, 2^, 

< HPe) + Pcl0g2iM-l)<l+P«NRt, (14) 

^ere Ha) » -oe loss^a — (1 - a) lo£^(l - «) for 0 < < I is tlie binary entropy ftuotion. 
From fiiis we obtain 

ir(y„) > Wi^) = H(.Y^,Z^,VO 

» myf.zY,W)--l-PeNRe. (15) 

Another step 

HC7C.z^,w) = ir(wo+fr(r3f^,z?'iJF) 

2: if(R0+/Cy/^.2^^f|RO 

= NRa't-H(X^\W)-H(,X^\Y^,Z^,W) 

> NIt^+H(X^)'-HiXf\Yf,Z^) 

Combinizig (15) and (16) we obtain 

iir(iii)><i-i>e.)JVi?<,-^i+ 2 irc^r^)^ ^ -fir(jti,ir„.2ri,). (i7) 

Note that by (12) inequajiiiy (17) can be rewitten as 

Hi7\D > (1 - Pe^Re - i/Ar+ H(-af|/) i?(^r. /), (is) 
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H(Y) > (1 - Pe)J^ - + HiX) - -ff(JSriF, (19) i 

Note that an admissible p« < jR^ + ^fwe 4. OandiV-^ 00. Therefore for adimsslblep£ we ^ 
obtain 

Pfi< W)-/(Xir,Z), (20) ! 

for some joint distribution PQc^ y, z) « Q(x}F(y, z\x)9 x QX,y ^y^z ^ 
Next we consid^ar fbQ cotnposite rate: 

> iVLnCr). (21) 

Here the last step follows fi'om the -faot that the Huffinan code is optimal, i.e. minimizes Che 
expected codeword length. Recall that an admissible Pc satisfies > i^c ^ for € 4* 0, hence 

Finally for the disfoxttons we obtain: 
and 

H'-^. - . .. 

Finally note that adn3i$fiible distortions satisfy > £>x;^ — 6 and A^sr & Dxr — € fori? 4^ 0, 
which proves the result, 



5 ^ Outline of the achieyability proof 

This proof is based on strong typicality, see e,g» Cover and Thomas [6], p. xxx» Fix {P(y , z\x),x g 
X^y ey,z G Z). This detemiines the joint distribution P(x,>i,sr) =b Q{x)P(y^s\x). Next 
fix > 0 and ablodc-lengfh N. 
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typical AT-sequencesxj*^ defined by 

for all jc e A', where #(x\x^) denotes the nmnber of occiorences otx in xi^. Then 

Px{X^^A^iX)}£8 (25) 

for all N laige enough. 

B. Note that P(y\x) ^^^^(y, z\x) f(xx ^ X.y e y. Now consider &r each xf € 
Af iX) the set (Y\x^) of j^-sequenoes typical with xf^^ Le. $Qqaeiice3 for which <hc 
actual numb^ of (x, j/) pairs is closo to the expected mmiben More formally, we require 

for all* € X,y e J?. Now it can be shown that, for all xj^ € >t^(^9 for all J\r laisd eoough, 
the fiize of the set (X\x^) is lower bounded by 

\A^iy\xf)\ > a^CW-fl^^d-l^-q. (27) 

Moieove!^ for all y^ e -4f (7|aff^) the average distance d(,x^,y^) is dose to the expected 
distance as repressed by 

dOc^.yf)^^ E ^;«^C*'*.J^>i):S(l + S)2]^[i>^(>:,y)]. (28) 

C. Next let Piz\x, y^=^P(y, z\x)/ P(y, z|x) for x ^ A', € z € 5?. Now consider 
for each x^ € A^(JO and;;j^ € (7 |Xj^) Ihe set A^iZ\xf, j/f ) of ^-^quences j^f typical 
with (xf', j^f ), i.e. sequences for which ihe actual nmnber of (x. y» pairs Is close to the 
escpected number. More fQ3Pmally> we require 

fbr all X s X,y ey,z e 2, Now it caabe shown that, for all jcf € AsCX)andy^ e ' 
). for all latge enough, the size of the set >lf (Zpef . y^) is lower bouadedby 

\A^CZ]x^.y^)\ > 2^<l-^^t^l^'^-«. (30) 

Moreover for all 6 A^ (Z\x^, y^) the avem^ distance <?Cxf , arf ) is close to the esi^cted 
distance as expressed by 

rfCxf ^ < (1 +«>2Bx«i:Dxa(x.2)]. (31) 

B. Hsjct consider the sequences y^ e -4^(r|af ) for some xj^ s -4.^ C^. Give eaob such 
sequence a random mesijage-latiel w, i.e. 

Pr{Jr(y?^)«u>} = -^for«>s{l,.--,M}. (32) 
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according to dislrib«iion PCz[y) ~ 2^' J»(x, y, ^)/ j;, a). Denote tMs sequence by 

(y^'). Now ibry^s ^(Xlx^'') ^i*ere e ^^(Af) we get tbat 

£. The eacodez; when it receives a sooice sequence xf i. A^(X)y deolaies an enor. Whm. 
the encoder receives a source sequence e (X) and message w as in piibi, it produces a 
composite sequence yj^ tibat satisfies 

^(y^) e ^(Z]x^,y^), (34) 

When no satis^ng (34) exists an ecror i$ deolaced. Also when an enor eeror is dedarod 
fhe encoder still produces a composite sequence (albeit afbitrazy) and tbe decoder still fimns a 
restoration se^i^oe. 

G. There are two Idnds of enors: 0) Ae source can generate an ^ A^(X)t or (ii) for 
x^ € A^(.X) there may not be anyj^ satisfying (34). 

H. The first probability i»J. can be made analler than S by increasing N, see (25). Ifx^ e 
A^QO ^e probability that a, specific y^ € .4^(y|xf ) lus the d^t message label and that 
Z^(y^) s A^iZ\x^,y^\ is not smaller than 2-JVCa+«)»Jr(Z|r)-a-o»»<Z|jr.y)+fl/j|^^ see 
bound (33) hence 

If s n V M ) 

S 2-^«, (35) 
iffbraUarf €.A^(;f) 

l>l5^(rte,^)|2-^»"H0='^cz|y)-(i-«)»iywy>+«i 
— ^ ' ^ 2: 2^«. (36) 

Note Ibat this holds if we take 

Now we let j 4^ 0 and -> oo. This yields tiie admissibility of 

p« = -Er(y[J0-^(^l7)+ir(zi-sr.D 
=5 ir(jr,y)-zf(j:)-./(jf;5riy) 

« ^(y)-W;r,z). (38) 

L The admissible distortions are what they sibould be. This is easily checked, since the 
distortion matrices D^y and D);^ contain only non-negative finite entries, since P'' + P^^ tends 
to zero for 5 4, 0 and iV -> 00, and since fhe bounds (28) and (3 1) hold when , yf , and 
axe jointiy i^ii^. Nate fhot &e composite rate h ^(7) is admissible since is typical with 
probabiliQr tending to one fbr(S 4.0 and jyr 00. 
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Theorem 1 is a quite general result on ^tnbedding of infoxmation. To undficstand the conse- 
quences of this theorem better, we consider some special cases. 

The imtKurtant featoze in all cases is fliat the embedding of infonnatlon resulta in & distottioii 
and tl^t this distortion should be small. Therefore in all seti^s there is an embedding rate and a 
distortion betwe^ the source an coinposite sequences. The differentation follows from putting 
di£EbiraS requirements on the distortion of the restoration sequence. We consider three cases 
here: (T) standard embedding, (it) reversible embeddMg, and (iii) self-embedding. Standard 
epibedding refers to Ihe case where we put no restdction on ^e restoration sequence and is 
discussed In Section 6. 1 , Reversible embedding requires that the restoration sequence has zero 
distortion with the source seqoence atid is discussed in Section 6.2. The last scenario refers 
to a scenario where do not put any constraint on the embedding rate» The relevance of such a 
scenario is discussed in Section 6.3. 



6.1 Standard embeddliig 

In this case we assume that random variable Z is not present and that there is no distortion 
toatdx Dxzi't ')- This hnmediately yields the following achievable region 

^xy>^xylX>xy(x,y)l (39) 

where entropies and e^fCpectations are with respect to some joint probability fhnction P{x^y)=^ 
Qix^P(y\x\ X e ^y. If we are not intraested in the value of the composite rate Pe we 
obtain 

^xy > ExyiDxyix, y)h (40) 

Not9 that this last situation was considered by C!h^ \2] and Barron [1]. They called tiiis the 
noise-fitse case to emphasize that the composite signal is not modified e.g. during transmis-^ 
sion over a noisy chaoneL In [13] codes &r noise-firee embedding in gray-scale signals were 
oon^dered' 

6J2 lEteversible embedding 

We assume here that we complete restoration is required, i.e. we want to reconstruct flie source 
sequence reliably. Therefore we just take Z — X. This leads to 

Axy > BxylDx^Qc, y)l (41) 

where entropies and expectations are withrespect to some joint probability function P(x, y} =: 
g(x)jP(y jx), X & Xjy Gy. If we are not interested in Ihe value of the composite rate we 
obtain 

£iKy>:l^yiDxyOefy)l (42) 
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Goljan and Du in [7]. They proposed a more or less ad-hoc method for reveisible embedding 
of data in image?^ This method is soboptijnal in two ways, (a) it does not coxisider the host 
symbol as side-infomiation dqiing embedding, nor (b) does it reconstruct the host sequence 
conditionally on the coinpodte signal. Coding techniijaes that improve iqpon the method of 
Rldtfchetal. [7]winbepiBsezitediQ[9], .... 



6,3 Self-embedding 

la this setiip it is not our intention to embed message-information but only to restore a better 
estimation of fbe source sequence &om a 'had' estimation ^/f^. 

A simple eKampIe of such a setap would be tiie case where is compressed to obtein 
a sequence within a distortion Axz. By (partially) encrypting or hashing a composite 
sequence is obtained with a (in general)laxger distortion Axy^ By controlling the degree of 
encryption both tfie rate and ibe distortion of the composite sequence can be controlled. In this 
view we deport &om a simple rate^distottion setup. As an index to the restoration sequence z^, 
the encoder can transmit a sequence of symbols that axe meaningful, and not just some string 
of abstract Symbols. Such a meaningful index is the sequence y^^ which is close to the source 
sequence irj^y close in tezms of a distortion measitte. The advantage of this setup is how that 
when errors occur during transmission of yf^ the symbols that were correctly received axe still 
informative. Restoration is not possible however. 

In a more information-theoretic view we have qixandzed version yf of fhe source sequ^^ce 
x^ and this sequence contains information to do a restoration. This restoration leads to z f . An 
additional prope»rty of this approach could be that only a legitimate user could do the restora* 
tion» for example when the restomtion decoder is conboUled by a secret tey. 

The optimal trad&-ofiP between composite rate and the expected distortion is e^qncessed by 
the admissible region 

Axy^^lD^{x,yy\, 
A;«>]B«,[i>,^(x.2)] (43) 

where entropies and executions are with respect to some joint probability ftanction y^ z) s= 
Qixyt'iy^ z\x). x^X,y^y,z^Z such that H(X) > IiX\ 7, Z). 



7 Final remarks 

The semp that we have studied here is somewhat related to the problem that was investigated by 
Sutlvong et al. [1 !]> [12]. However their problem concerns transmission, ou3^ is an embedding 
problem. We want the distortion between source and composite sequence to be snaall whereas 
Sutivong et al. have a side-information channel th^t determine? what will be received. 

The concept of "stealing bits from a quantized source" see [4] is related to our setup via its 
objective* Also Cohen et al. want to embed infotmation by allowing (oKtra) distortion. 
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CLAIMS: 



1. AmettiodtoTeconstnictaniiiiprovedappn^ 
fto a lower <j>iality ^>pn>xtoafion •y\^OT^ 

a) * Y' asaumee values that could have been jaodncedby a first quantizer 'Ql % and 

b) 'Z* is obtiripfid from *Y» by iHterpretmg the quanfizafion indices of 'Ql' as indices 
fox a second quantizer *Q2% wbete 'QZ' is possibly d^endent on 'Y\ and possibly in 
coiairaotion with aieotdeting m^qp of iiie indices. 

2. A mefliod as in claim X, wbece *Qr is a scalar quantizer and *Q2' is a vector 
quantizer. 

3. Amethodasinclaiml,wbereMgbquali1yieconsfiuc1iottto^ 

hidden from unKcenped users; 

a) Thfi quantizer 'C^' is hidden fSwn mOicensed users; 

b) The reordering map is biddjsn fioTO unUceosed users. 

4. Anapparatusoomprisin§circui1iyforifflplenie0tingthestq)8ofam 
claimed in one of olaiuos 1 to 3. 

5. A computer program product enabling a programmable device when execothis 
20 said computer program product to function as an apparatus as defined in claim 4, 
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ABSTRACT: 



This invention disolosurs addressee the problem of embedding in&naatioii £)r 
hi^ caaHsiy zestoratioo. in a lowi^ quality sigaal» where Ihe signal is typically an audio-visiuil 
sxgpal. 
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